Neural Networks with Smooth Adaptive Activation Functions for Regression

ConvNets with Smooth Adaptive Activation Functions for Regression

Within Neural Networks (NN), the parameters of Adaptive Activation Functions (AAF) control the shapes of activation functions. These parameters are trained along with other parameters in the NN. AAFs have improved performance of Convolutional Neural Networks (CNN) in multiple classification tasks. In this paper, we propose and apply AAFs on CNNs for regression tasks. We argue that applying AAFs...

Forecasting Gold Price Changes: Application of an Equipped Artificial Neural Network

The forecast of fluctuations and prices is the major concern in financial markets. Thus, developing an accurate and robust forecasting decision model is critically favorable to the investors. As gold has shown a special capability to smooth inflation fluctuations, governors use gold as a price controlling lever. Thus, more information about future gold price trends will help to make the firm de...

Modeling of streamflow- suspended sediment load relationship by adaptive neuro-fuzzy and artificial neural network approaches (Case study: Dalaki River, Iran)

Modeling of stream flow–suspended sediment relationship is one of the most studied topics in hydrology due to itsessential application to water resources management. Recently, artificial intelligence has gained much popularity owing toits application in calibrating the nonlinear relationships inherent in the stream flow–suspended sediment relationship. Thisstudy made us of adaptive neuro-fuzzy ...

Error bounds for approximations with deep ReLU networks

We study expressive power of shallow and deep neural networks with piece-wise linear activation functions. We establish new rigorous upper and lower bounds for the network complexity in the setting of approximations in Sobolev spaces. In particular, we prove that deep ReLU networks more efficiently approximate smooth functions than shallow networks. In the case of approximations of 1D Lipschitz...

Modeling and Control of Gas Turbine Combustor with Dynamic and Adaptive Neural Networks (TECHNICAL NOTE)